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Abstract 

Weather is one of the major causes of general aviation accidents. Researchers axe addressing this 
problem from various perspectives including improving meteorological forecasting techniques, coUecg 
additional weather data automatically via on-board sensors and "flight modems, and ^ovmg^ther 
data dissemination and presentation. We approach the problem from the improved presentation p P 
tive and propose weather visualization and interaction methods tailored for general aviation pilots. 0 
Systran A viaticm Weather Data Visualization Environment (AWE), utilizes information vision 
SU • manipulation gt.ph.cal interface, 

situational awareness of relevant weather data. The system design is based on a user study and feedbac 
from pilots. 


1 Introduction 

„ , . .. „ //~i \ \ -afetv rests on four pillars of situational awareness: position, terrain, traffic, 

“So, in over 30% of accidents and over 15% at fatal accidents [2J. One posstble cm* - tot the , pdot 
Av not absorb and retain ail the weather information he/she is required to revtew prior to flight. Because 
more data is provided than is applicable to a given flight and the data is presented poor y, 1 requires mu 
r^tciguMve effort to deveTop , "big picture” view of the weather, especially m an unfamiliar area. In 
this work we focus on providing weather situational awareness to general aviation pilots. 

Thereme st“»T components of weather that a pilot needs to be aware of in order to mamtarn weather- 
relalS ^".uation J ajm«ess. These components include surface winds and winds aloft, doud conditions 
and visibility conditions. Important classifications of weather related data and information on weathe 
trends to alert the pilot for topending danger or assist him to path planning or replannmg is important. 
Communication of all this information effectively so that the pilot can assimilate and act on the mforma 

“ °A S'toZtf 'researchers have addressed the poor presentation problem by developing ^ic^g. 
of aviation weather for use prior to flight. However, most of th« i systems are Mtolorrf totontoosd 

• r „ .si in,+-c P7l Tbp concerns of commercial airline pilots are different and have been discuss y 
emdier work [11]' Our system AWE (Aviation Weather Data Visualization Environment) ^ C ^° n p ^°^| 
weather data tailored to the needs of general aviation pilots using visual displays [11]. In Ac 

focuses on graphical displays of three weather elements, namely, meteorological observations (METARs) 
terminal area forecasts (TAFs), and winds aloft forecasts and maps them onto a cartographic grid spec 

“ '^^TpilSu. NASA Ames Research Center, CaMorma, tod found^hetoefto Jll^ 
displays that provide much improved situational awareness. Second, we pr 

processing functionality that will reduce head-down time for the pilots ^ 3 Sectl0n 4 

Section 2 presents a brief background followed by our previous work on AWE in beet on d. *ecao 
describes the new information displays that incorporate pilots' fadtock « . mdudmg 1™^^ 
mation, tod display of multiple forecast elements or multiple wmds aloft. Section 5 presents sprecn 

interactions within AWE. We conclude with our fiiture plans. 
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2 Background 


Significant advances have been made in the last decade in both weather 

ization for a variety of audiences including scientists, forecasters and the general public M- 

TV production systems such as the TViVis system [9], interactive 3D weather visuahzatmn 

VISUAL operating in the German Meteorological Office (DWD) in collaboration with Fraunhofer IGD and 

^l^Weather-on-Demand products through the internet are available. 

visualization systems are also being developed. Numerous aviation weather visualization efforts are un er 
way including those at the Federal Aviation Administration (FA A), the National Oceanic an WSI 

Admhfistration (NOAA), the Naval Research Lab, Rockwell Science Center, Honeywell International, WSI 

Corporation BFGoodrich, MIT Lincoln Lab, Echo Flight, and Jeppesen Inc. . . 

C Li spite of all this progress, however, like other audiences, pilots axe requesting tailored visualizat on 
tools for their specific needs. In particular, existing and developing weather forecasting anvisu iz 
technology needs to be harnessed appropriately for the benefit of pilots. The goal, as out ine ? . . 

manager of NASA’s aviation weather information system (AWIN) project, is to provide wea er m f 
TeSe to the pilot’s flight path, present it to the pilot in the cockpit in « e^y-to-interpret graphical format, 

and give him decision-making aids to help him use that information . ... [ J- National Center 

The Aviation Digital Data Service (ADDS) system [10], a joint effort of NGAA, he National^e 
for Atmospheric Research (NCAR), and the Aviation Weather Center, perhaps comes closes t to fid * & S 
the AWIN goal Initially released in 1997, it provides unofficial graphical displays of a variety of avia 
wei^brie 6 Sg report elements and allows pilots to zoom in to get more specific information about an area 
Jtterest. Although it presents a great variety of weather graphics, so-called 

described later in Section 3) are displayed only textually without any filtering. It also does not relate 

dat ^° mos^imp^rtant 1 offic^ 1 source of aviation weather reports for general aviation pilots in the United 
States is^ oTecTuser Access Terminals (DUATs) [3]. However, most of these briefings are textutd or verbid 
In particular, DUATs does not provide visualization of three of the most maportant el^n^ a we^ 
hriefine- airport-specific current weather observations meteorological observations, or METARs) terminal 
and winds aloft A more thorough description of related i systems rncludurg 

details on the DUATs system and the data it provides can be found in our previous wor [ J- 

3 AWE: Aviation Weather Data Visualization Environment 

We now present an overview of our previous work on AWE (Aviation Weather Data Visualization Environ- 
ment) [11]. We also provide details on some specific displays in order to explain severa impr v 
have incoroorated in AWE to increase the situational awareness of pilots. 

L ATO wc hl designed and tested three visual displays to, communicating current and fore st 

conditions^! airports inching clouds, visibility, and surface winds and 

winds aloft forecasts. A pilot can use a graphical user interface to interact with the weathe P 

chmt^iS'DiSuy Background: The weather data is overlayed on a VFR (Visual Flight Rules) 
secticma[ aertmaurihaf chart) as sb£n in Figure 1. The chm, shows the io^ion o abports £■-*» 
nr blue circles or short lines that mimic the runway layout), airways ( highway y 

light blue straight lines), navigation aids (mostly depicted by a compass rose), contro led and special use 
airspace obstructions natural terrain features (such as water and hills, depicted using color coded altitudes) 
SSphi? Ernes’ (such as cities, depicted in yellow), and maximum elevation m i each area dep £ed 
w 7h numbers with superscripts). Although the background may look cluttered and complex^ the chart 
background texture gives pilots a familiar environment with which to “ te ^ s ^ oft P ™g e d ds of h 40 knots 
additional information for making their ” go/no-go” decision. For examp e, 

arp mil . h more problematic if you will be flying 2000 feet above mountains than if you 11 be flying 2UUU teet 
over flat terrain P Overlaying the weather on the chart consolidates weather and terrain situational awareness 
Xwm) the pilot «c maL I decision by looking only a. on, source. Displaying weather 
the airport it applies to improves a pilot’s ability to perceive the big picture, y , u 

where he otherwise needs to look at a chart to determine where each airport ,s located and how it relates 
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flight path. Displaying surface wind information near the airport also improves the pilot s ability to visu y 
determine a landing runway and determine the amount of crosswind to expect. It provides information w i 
still away from the airport, that is commensurate with the information he receives from the airport wrnd 
sock We decided on using a VFR Sectional chart as the background after considermg several alternatives 
as described in our previous work [11]. The use of VFR aeronautical chart drew unanimous enthusiastic 
response from the pilots. 



Figure 1: Current cloud, visibility and winds conditions shown using the symbolic and textual formats. The 
background image is an aeronautical chart for the San Francisco Bay Area. 


Input: AWE begins with an official briefing downloaded from DUATs and extracts current airport 
condition reports, airport forecast reports, and winds aloft forecast reports. A DUATs current airpor 
conditions report, shown in Figure 2, provides data about surface wind velocity cloud ^ ltude ^ c ^ S 
amount, visibility and obstructions to visibility, temperature, dew point, and barometric P^ssure setting 
A DUATs airport forecast report (terminal area forecast), shown m Figure 3, provides pre 
surface wind velocity, cloud altitude and coverage amount, and visibility and uge 

Visual Displays: We now describe the three visualization formats used m AWE. All three displays use 
the common fields listed in the previous paragraph; the textual format adds a few additional 
For ease of interpretation, we chose to use similar display methods for both current and forecast cond^ons 
Symbolic Visual Display: The symbolic format is shown in Figure 1. The top rectangle of the : symbo 
depicts wind velocity. Wind direction is shown by the direction of the arrow, while wind speed is shownby 
th^ thickness of the arrow. This method allows a pilot to quickly glance at the display and visually de 
frongSs The border of the rectangle is also color-coded (red for very strong winds, ye low or somewhat 
strong winds, and black for reasonable winds) to further enhance the pilot’s abihty to quickly determine wind 
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KSQl 1 81 6462 
KSFO 18TS5SZ 
KPAO 1816462 
KSJC 1816532 
KHHV 181 6532 
KHWD 181 6542 
KOAK 1816532 
KLVK 181653Z 
KCCR 1 81 6532 
KAPC 181653Z 
K5CK 1816562 
KSAC 181656Z 
KMOO 181 650Z 
KMRY 181654Z 
KSNS 181653Z 
KWVI 181 6532 
KVCB 1816532 
KSTS 1 81 6532 
KMCE 1816532 


18014KT 

24008KT 

(J0005KT 

OOOOOKT 

OIOOOKT 

040G6KT 

07007KT 

OOOOOKT 

05004 XT 
03007KT 
27006KT 
33004 KT 
06003KT 
0501 6KT 
1 1 022KT 
1101 2KT 
35007KT 
OOOOOKT 
OOOOOKT 


85M NO 
10SH NO 
1 05M NO 
9SH NO 
1 0SM NO 
1 OSM NO 
ItJSMt NO 
SSM HZ 
1QSM NO 
20SM. NO 
tSM NO 
0.25SM FG 
5SM BR 
.3SH RA 
6SM SH 
9SM BR 
1 0SH NO 
4SM HZ 
7SM HZ 


FEW012 SCT050 BKNO0O 11/08 A3022 
FEW012 BKN060 11/08 A3022 
FcWOI 5 SCTC50 11/08 A3021 
FEW1B0 09/07 A3021 
FEW01 5 SCT1 00 10/07 A3022 
SCT050 OVCIOO 11/07 A3021 
FEW020 SCT040 OVC070 11/08 *3023 
CtR 09/06 A3021 
FEW035 OVC060 11 /0.0 A3023 
FEW030 SCT050 lt/08 A3023 
OVC001 07/07 A3021 
OVCOQT 07/Q7 A3022 
FEW015 SCTQ50 04/04 A3021 
BKN020 0VC04Q 16/04 A3014 
SCT020 BKN035 14/07 A3016 
FEMJ30 6KN06O 18/07 A3016 
CtR 15/07 A3019 
SCTOl 2 BKNQ25 14/06 A3019 
CLR 12/C9 A3019 


Figure 
by the 
speed, 
point, 


2- Sample current airport conditions file. Each line represents a report for a specific airport, specified 
airport identifier (first element). It also specifies the time of observation, wind direction and wind 
visibility, visibility restrictions, cloud layers (with coverage amount and altitude), temperature, de 
and barometric pressure. 


KSFO 1 81 730Z 181818 050G7KT P6SM FEW010 SCT050; 
BECMG 2223 28010KT P6SM SCT100 SCT200; 
FM0300 30005KT PS5M SCT0B0 BKN100 BKN200; 
BECMC 0708 070G5KT P6SM SCT2QQ; 

KSJC 1817307 181 81 8 300Q3KT P6SM 5CT200; 

BECMC 2223 3201 7KT PGSM FEW050 SCT200; 
FMG300 32008KT P6SM SCT050; 

FM0600 00003KT PBSM SCT040 BKN080; 

FMO900 18020KT 3SM BR BKN020 OVC080; 

FM1600 00003KT P65M SCT200; 

KOAK 1817307 181818 07007KT P6SM 5CT200; 

BECMG 2223 28007KT P6SM BKN100 OVC200; 
FM0300 31005KT P6SM SCT100 0VC2O0 ; 

BECMG 0708 G6005KT P65M SCT200; 

KSCK 1817352 181818 3000GKT PBSM SKC; 

BECMG 0102 00003KT PBSM SKC; 

FM0800 OOOOOKT 3SM BR SKC 
FM1000 OOOOOKT ISM BR SKC ; 

TEMPO 1015 0.25SM FG W002; 

FM1G00 00003KT 3SM BR SKC ; 


Figure 3- Sample airport forecast file. A forecast for an airport extends from the airport identifier to the 
dof(” ” ) Each forecast provides the time the forecast was created followed by the effective times of earh 
forecast elerrmnt. Each element specifies the wind direction and speed, visibility and restrictions to visibility, 
and cloud layers (with coverage amount and altitude). 


C °°The middle rectangle depicts cloud information. The rectangle represents altitudes i from 0 feet . (at . the 
bottom I'toll 000 feet (at the top. below the wind rectangle). This rectangle is then filled wrth snb- 
Ses to reTesen. cloud altitude and coverage amount. The FAA has defined five range* for cloud 
^“?ie can be reported to be clear, ma, have fee clouds (FEW = l^s than 1 f 

covered! scattered clouds (SCT = between 1/8 and 3/8 of the sky has clouds), broken clouds (BKN - 
4/8 to 7/8 of the sky), or be completely overcast (OVC = 8/8 of the sky). The FAA also provides a list 
of standard contractions for visibility obscurations. Our examples are not for comprehensive coverage b 
rathe, for general understanding, so not ail options are described. Using infonnarion 

oromoted by Tufte [12, 13] and Bertin [1], we map these five ranges to five gray levels, white for dear skies 
progressively darker gray for few, scattered, and broken clouds; and black for an overcas s y. ou cov g 
Ld altitude are measured by ground-based instruments located at the airport ^d can be reported as laye s^ 
That is cloud information may be reported as few @ 1200 ft, set @ 3000 ft, ovc @ 12,000 ft. Hence cloud 
coverage is depicted by lavering appropriately colored sub-rectangles at a vertical position determine y a 
Ifoli mapping^ from 0 to" 12,000 feet. Similar to the wind rectangle, the cloud rectangle is color-coded to 
l“erpr2tion. The cofor-coding takes the cloud layers into consideration as well as the information 
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Figure 4: Sample winds aloft file. The airport identifier is followed by groups of three elements, wind 
direction, wind speed, and temperature. These groups of three are available for prespecified altitudes from 
3000 feet to 39000 at various increments. 

displayed as text in the bottom rectangle: visibility distance and any obstructions to visibility, such ^ fog, 
haze or smoke The border is colored black if the clouds and visibility allow a pilot to fly under vi 
fSbrcken or overcast cloud layer, or ceiling, at an altitude greater tha„ ^ ft 
than 5 miles), yellow if the ceiling or visibility is marginal (ceihng greater than 1000 ft but less than JOUU tt 
and visibility between 3 and 5 miles), or red if the ceiling or visibihty is low enough to require flight u g 
instrument flight rules (ceiling less than 1000 ft; visibility less than 3 miles). • . t 

Both current and forecast airport conditions can be displayed usmg these symbols. Jhey provide most 
data needed to plan flights. Other data available in current condition reports is not usually necessary but 

S ° m p^Zl U D^lay with Color-Coded. Borders: If a pilot wants to view the above mentioned data teiftuaJly 
or if he wants to see precise numbers for the other elements, he can ask for a textual pr^nta ion ^ shown 
in Figure 1. This format shows all the elements provided. The text rectangle is color-coded • usmg the 
coding we used for the middle rectangle of the symbolic display. That is, it represents the visibility a 

cloud coverage combination and can be red, yellow, or black. , . i 

TMl Iconic Display: The last forma, a pilot can revest is the icornc format which provide* tt 
overview of wind, visibility, cloud altitude, and cloud coverage data In the current conditions icon, the 
temperature - point spread (that is, temperature minus dew point; useful for detecting posabfc ** 
formation) is also shown. It displays these elements using four sub-tnangles arranged into a single tnang . 
STc™ in Figure 5. Each sub-triangle is color-coded using the colons white for good condition. .yellow 
fortaSni conditions, and red for adverse conditions, as defined for the symbolic format above Because 
the airport forecast reports do not provide temperature or dew point information the center sub-tnangle is 
colored gray when displaying forecast data. The iconic display is useful in providing a very quick overview 
of conditions. A pilot ci quickly get the big picture of the weather situation. For example, if the bottom 
section of the triangles is red in a wide area, the pilot can quickly understand that there^s widejread low 
fog. On the other hand, if a geographic area shows all white triangles, he can easily see that at least the 

elem j Wb&Aty DisXl^^y bemuse they are 8 complementary to current and forecast airport c °^ on 
reports, we also provide winds aloft forecasts graphically. The winds aloft forecasts report shown m F^re 4 
provides data about the wind velocity and temperature at predefined altitudes, generally speaking ranging 
from 3000 ft to 39,000 ft in increments of 3000 ft. We found that pilots preferred a very siinp e repr 
- one that does not require much interpretation. Thus, we display the wmds aloft for a selected altitude 
asTdfrectionS arrow, as shown in Figure 5. The direction of the arrow specifies the direction the wind 
coming from. The wind speed is shown textually on the arrow. The pilot selects an altitude usmg a s i 
provided on the graphical user interface. As the pilot drags the slider, the win arrows c ange o 
winds at the selected altitude using interpolation to compute winds at altitudes not given 1 m i e win 
forecast report. This helps the pilot choose an appropriate ermsing altitude and appropriate flight p 

Wlt ^fof thribOT^f^fts^^be displayed for an entire area or just along a pilot-selected route of flight. 
For winds aloft displaved along a route, we use distance-based interpolation of the two closest wind repor mg 
sftesTo compute winds at selected locations. Similarly, if current conditions or forecasts are requested for 
Sports thafdo not provide reports, the nearest available reports are displayed. This provides the pilot an 

estimate of what the weather may be like at his selected airports. . 

We conducted a user study to test the usability of the above formats. Through interviews and a QU^tion- 
nairt we determined that pitots preferred ou, graphical formats over seven formats from four competitive 
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Figur, 5: 0»r ren « weather co.di.tons shown ustog the iconic formats Wi.ds a. a pi,o.-seiec«d altitude 
shown with a cyan arrow. 

systems. The study also revealed areas for further improvement. In the next two sections, we discuss some 
of the most important feedback from the user study. 


4 Information Displays 


multiple altitude winds aloft forecasts. The following subsections describe these new display . 

4.1 Trend Information Display 

In onr original implementation of AWE, we provided 

" - * - “ 

whether these predictions are accurate or not. , + pn j disolav. On the top layer, we 

In order to address this feedback we present ^^^+1 using the symbolic representation as shown in 
display the forecast applicable at time t - 2, t - l, t, and + g y symbolically and 

Figure 6. On the bottom layer, the actual conditions at time - 2 *■ -1 are too V q 

aligned with the same time stamps of the top layer as shown in Figure 6 actually changed, 

associated with a given airport provides a pilot with mforma ion ^ ^ ^ ilot can d ecide whether the 
When compared with the forecast for that time period on ^ the* top ^ ^ 

current conditions m wind, cloud, or visibility isp y based'approaches can be used to derive 

shown in the top layer. Although statistic an ar 1 ci comfortable and tru sting of raw data 

a^e designed todeS S3£ 

ZSZ W ei,et angmen.ing . 

replacing the suggested displays. 


G 


By studying Figure 6, a pilot can see the discrepancies between the actual readings and the predictions. 
Observe that the surface winds are predicted to be calm consistently while the actual readings consistently 
have a wind in the easterly direction with stable speed. For visibility conditions, the predictions are that the 
fog (and associated low visibility) will dissipate after 14:00 and the visibility will improve to 1 mile ( om 
0.25 mile). Observe that in actuality, the visibility is improving more quickly than forecast and is already at 
3 miles. The clouds are also lifting so the forecast for ceilings above 12,000 ft (shown by the white rectangle) 

is plausible. , ... 

Although here we have discussed the trend information to be displayed using symbohc representation 
only, we have implemented the weather trend display using other visual methods such as the triangular iconic 

displays discussed earlier in Section 3. , . . 

There are certainly other display possibilities for weather trend information such as the direct grap ic 
displays of the three elements using both actual and predicted conditions. While such a display may be 
more useful for longer time periods because they may occupy less screen area, we preferred to build on the 
original displays designed in AWE because of two reasons. First, the trend display is an extension of the 
static one time display and therefore, does not cause any additional cognitive workload. Second, continuous 
graph-based displays seem to be less suitable for picking out exactly where in time the pilot is in comparison 
to the discrete displays that we have designed. Certainly, we need to conduct another user study to determine 
the efficacy of the new information displays presented in this work. 



Figure 6: Display of trend information for an airport. The top layer displays the winds, cloud, and visibility as 
predicted; the bottom layer displays the winds, cloud, and visibility as measured. Correlation or discrepancy 
between the two layers allows pilots to determine how reliable predictions are likely to be. 


4.2 Multiple Forecast Element Display 

In the original implementation, AWE automatically selects the appropriate forecast for the destination 
airport based on the pilot’s estimated time of arrival, ETA. However, the user study revealed that pilots also 
wanted the ability to see the forecast for nearby times to better determine how certain the forecast is for 
their ETA. That is, if the weather is predicted to change 30 minutes after their ETA, it may be prudent for 
the pilot to have a backup plan in case the change occurs earlier. Similarly if they are planning to arrive 20 
min nt.es after the fog is forecast to clear; they may want to plan for an alternate destination if the fog does 

not clear on schedule. .. _ . , , 

We have incorporated this suggestion so that AWE now has the capabihty to display the predicted 
weather for all time periods provided by the DUATs report for pilot-selected airports. Rather than having 
AWE select the appropriate forecast for the estimated arrival time, AWE can now display the entire senes of 
forecast elements. We refer to this display as multiple forecast element display. AWE can use any one of the 
three visualization methods - textual display with color-coded borders, overview triangular visual displays, 
or symbolic visual displays - to visualize multiple forecasts at several airports simultaneously. Figure s ow s 
an example of a triangular overview display for three airports simultaneously. The fourth airport shown wi 
a single triangle is one the pilot has not requested additional information about. Hence, only the element 
applicable to the AWE-computed arrival time is shown. 
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Ftom this display, the pilot can see that, although there ate tout elements given in '[”• 
of h* selected airports (olland Internat.onal, left side of the 

acceptable surface wrnds, visibdity, and cloud conditions during f be IVate 

can only determine if a change is forecast. 



get a quick overview of forecast conditions. 


If a change is forecast, the pilot can ask for additional details to determine how it may affect his fhgh *■ 
He can mix-and-match different kinds of displays to extract just the information / 

ESSSSSSS^Ih H 3S» 

can now see that Oakland airport has four e emenft (th e whfte tong, ^ i J ^ ^ 

I'Z o?r image, are caused by a ftont mov to g through, 

with associated decreasing ceilings. 


4 3 Multiple Altitude Winds Aloft Display 

4WE allows the pilot to evaluate g^^^^^^^^^^Jtudy'rnv^ed^that^'l^t^w^trf 

"iTr^tsfo' 5 ^nTIft altitudes simultaneously to formulate a better big picture. To formulate^ 

:^™nirp“«tS2: be 

concurrently to allow for a qmck visual evaluation. _ = d ^ oft rep orts provide forecasts for 

^ooo'ft 6 AnTvample »cto airport ZLn in Figure 9. Winds are displayed from 3000 

m ‘ft, the top The f d 

-«■ «— f » ™ ds (< 10 kts) - yeBow (< 
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Figure * Overview o t weaker — - 

format. The display for SFO airport shows on y forecast to develop (upper right airport) and a 

two airports displaying symbolic trend mform * ™ te | decre asing visibilities and ceilings. The textual 
front moving through (lower center arrport) with * throo6ho „, the forecast period, the 

trend information shows that although con 1 1 ^ display is likely to be useful to the general aviation 

to land at an alternative airport or expedite or delay the fhg t 

arrival time. 

20 Us) for moderate winds, orange (< 30 Us) lot dUterMt's always the same 

DUATs reports; hence, they are easily internalisahl. hy pilots. 





Speech-based User Interface 


f opccwi 

’he original implementation of ^ 

he pilots was to incorporate a speech-based user mterfa ■ ^ the textua l data. In an eyes- 

muld not have to dedicate much eye time an speech-based user interface will allow the use 

iusy, hands-busy environment such as flying an ^r^aspeec ^ ^ overload between different 

f an additional modality to interact wlt ^ 6 Sy is perform fog multiple tasks, performance improves 

enses. Experimental evidence indicates that if a up t ^ modalities [8]. Moreover, it is 

f those tasks can be managed over independent ; P / P the disadvantage s associated with 

ixpected that a speech-based interface applications. 

VIMP (windows, icons, menus, pointing dev ) , soeech-based user interface. Speech has a 

To make AWE easier to use in flight, we ave now ation fr om AWE without having to devote 

lumber of advantages. Usmg speech, the P 1 0 < “ an . rea i_ esta te needs. Small GA cockpits do not allow 
nuch visual attention to the task. P eec 38 °^ , &g ^ input mo dality is quicker than either typing or 

•£* - — - — * ypist c ” produce 80 ' 100 wpm ' 


9 


and one can hand .rite a. iess than ‘yping *££££ 

than reading. It’s also temporal, serial, bulky , an m y . , , , vocabularies and limited grammars. 

: i d h rrr:= — i- - - 

accent. . n a rirvm^in for a number of reasons. First, the 

The advantages outweigh the disadvantages “ ^ speaking countries. However, non-English 

official language for aviation is English, even mm y S , t j enough English to transfer 

pi, °‘ s " “ a ““ med 

to the speech synthesizer accent because some weather data is aireaHy synthesized 

Given the advantages and limitations of speedi, we have J — d ^ focused on a 

face) for AWE. We did not implement a natural language understan g y^ ^ ^ ^ input and 

specialized vocabulary and grammar that gener avia ion p express needs and obtain services 

output modality. The objective is to provide the p. lot wr th a ^ ^ uger 

"r ^ fi ° d the - more 

pleasant to use. , rr TfT for the GUI and runs under Linux. For the 

AWE was implemented in C++, uses OpenGL and GLUT for the W an To improve 

SUI. .e choc BM’s ViaVoice for Linux products for be issued to the 

speech recognition accuracy, we designed a grammar sufficient expressive power 

recognition engine. The challenge here is to design the g« sot he pdot ha, sufficie ^ ^ 

to ask for what he needs, but the grammar remains inn ('SRCL1 which is basically a BNF (Backus- 

grammar is written in the Speech Recognition Control ■ ^ >d|lc( J 0Bl rules 

Naur form) grammar adapted to speech recognition. 1 e a ^ developer to specify optional 

with non-terminals, terminals, and some predefined tenamah Lri airport 

words or repeated words. The AWE aurally Some example 

conditions, airport forecasts, and winds aloft forecasts, and to P 6 * 

sentences the grammar accepts include 

• show area current weather as symbols 

• show route forecast as Icons at 15 30 zulu 

• hide route winds aloft 

• say winds at Palo Alto 

• say forecast visibility for Monterey at 18 hundred 

• set display type to icon 

• show trend information for Stockton as icon 

AWE can respond to the pilot’s directives by either g | ap , hl ^ ft f ^ t ^ strate^for'aural feedback. AWE 
or aural feedback (for say commands). We c ose ^ wait for a yes or n0 before answering. Rather it 
does not explicitly ask the pilot Did you say .... , . t j ie p q ot knows the request was 

provides . succinct answer to , query but also provides enough context would r Lue the 
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6 Summary and Future Work 


AWE (Aviation Weather Data Visualization Environment) has been tailor dMgnrf W suit the of 

user study with pilots 

resulted in useful feedback about the usability of AWE. r,ilot.s’ feedback In particular, we 

In this work we have provided additional functionality based on the pilots teedbac . P 

“rr^totrth^nhance AWE to 

— - - - 

W %tlir^»d^^^wr“- win enhance AV^ 

information it determines may be of use to the pilot. For al the evolving conditions. If it 
AWE can automatically look for inconsistencies between the forecasts g be 

detects any unexpected conditions, it can spontaneously warn the pilot. Of course, all 

available to the pilot for his own exploration. awareness of the weather situation. 

— - ith 

reduced workload. 
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